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ABSTRACT 

*...tiBie  study... May  b«  defined  at  a  procedure  for 
determining  the  amount  of  time  required^  under  certain 
atandard  condltiona  of  Beaaureaent^  for  taaka  InTolTlng 
aome  human  aotlTity."^  One  of  the  most  important  phaaea  of 
a  time  atudy  is  that  of  rating  the  Job  pace  or  rate  of  ae- 
tlTlty.   It  la  here  that  judgment  on  the  part  of  the  rater 
playa  a  major  role*  The  major  obJeotlTe  of  this  thesis  Is 
to  examine  the  current  state  of  tlme-atudy  rating. 

A  group  of  seventy-two  rater a,  nearly  all  aotlTe  time 
atudy  englneera,  gathered  at  the  1960  Purdue  Work  Session, 
were  the  cross*sectlon  of  the  profession  whose  work  furnish* 
•d  the  baais  for  thla  atudy. 

A  aeries  of  eighteen  films,  three  paces  each  of  six 
different  actual  industrial  Jobs,  were  shown  in  entirely 
random  order  of  pace  and  job*   Sach  rater  aaalgned  ratlnga 
exactly  as  if  the  joba  were  being  performed  in  hia  own 
plenty  according  to  hia  own  company  standard  and  company 
policies.   These  ratings  were  converted  by  him  to  a  common, 
comparable,  numerical  baais  to  facilitate  further  analysis* 

Previous  to  the  showing  of  the  fllma,  personal  data 
queatlonnairea  were  individually  filled  out,  thua  providing 
the  neoesaary  information  for  assembling  the  dsta  according 
to  varioua  parametera* 


1.   M.  E*  Mundel,  Motion  and  Time  Study  Prlnciplea  and 
Practicea,  New  York,  Prent Ice-Hall  Inc.,  1950,  p.  1, 
(Prom  Uanuscrlpt ) * 
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•^it«^a'&  ^l}i/;fs-Maii  lo  e^tacTa   ^0«'x«ij;/9      '  '   »al«iax*  o4 
0mii  ^vtiOB    ll»   xltmBa    «at»tfai  ov;f~^:}n»vea   lo  q^oi^  a 

"deliiijjl  Atov  »«Griir  aoJtiiB«lo^g  •iIj^  lo  floi^oea-Bfioto  sri^  •■!•« 

•Xbjtf^a   aldt  rcol   alaaif  ailit  £>• 

xla   lo  cto»«  asoaq  aefuii    , ami  11  ii»*iiij|ia  lo  aaliac   A 

^Idii^fla   at  xnroxia   ^^lav    ,Bdot   ialid'ai/ftal  l%ui9»   iaaiallif) 

a^xiliai  baa|^la8«  to^ai  lioaa  i^oa  aoaq  lo  lob'xo  nobtmn 

imo  aifi  nl  bMrxoliaq  gnl^d  a^aw  adot   ftil^  11  •«  x-^^^"* 

^naqaoe   biiB  biabaaie  t^>*qfflOo   nwo  alii  o;f   ||nJjb*xo9oa    ^itmlq 

^ncMBdo  a  o<r  aXri  %<!  b^it^Yaoo  aiow  a8al^««t  aaeilT      .aalolXoq 

•aJLa^Iaoa  i«ii^'U)l  a;te;)iXlo.Bl   o^  aia^d  iBoliamun   ^el(S»Jnqmoo 

a^ab  lanoaiaq   «a»I|l  ail^   lo  ^iwoda  •il:r  oii  zaotva't^ 
^IblTonq   a>  tjo  6eXXll  ^XXsirMvlbal  eiaw  aoiiaoitol^aeirp 

anlbioooa   a:fab  »di   a^lXdaaaaa  ^ol  nolcfafiinolnl  Tiaaedoaa  »dc^ 

•  Brco^tanaiaq   Bvoliav^   o;t 


Th«  data  ao  obtainad  wa*  arranged  and  conputatlona 
■ado  in  auoh  a  Banner  aa  to  parMt  of  analyaia  aa  to  oon* 
sisteney^  aoctiraeyy  and  anount  of  TtAriatlon.   Alao,  it  waa 
daairad  to  aacartain  what  outatanding  diffarancaa,  if  any, 
night  be  found  with  ragard  to  tha  following  paraaatara: 
yaara  exporiance^  coneept  of  standard,  initial  training, 
aisa  of  rater* a  own  plant,  geographic  araa^  and  aisa  of 
oity  in  which  plant  ia  located* 

Tha  ratings  on  each  film  were  arrayed  for  the  whole 
group  and  by  each  subdiyiaion  of  the  major  parameters.   Con- 
sistency is  a  measure  of  how  thn  indiTidual  rating a  are 
grouped  about  their  arithmetic  mean;  accuracy,  of  how  they 
are  grouped  about  a  least- square a  corrected  mean. 

In  order  to  carry  out  the  other  objectivea,  it  became 
neceaaary  to  find  an  additional  baaia  for  comparison  be- 
tween the  varioua  parameter  subdivisions^  this  baaia  to  be 
capable  of  conaolidation  of  much  bulk  into  a  few  atati sties 
that  will  aubmit  to  further  analysis.  Thus,  for  each  ar- 
ray, limit a  were  aet  up  at  the  tl%,  t7i%,  llO%,   and  the 
180^  levela  about  the  actual  meana  to  measure  consistency, 
and  aimilar  limits  were  set  about  tha  corrected  mesne  to 
maaaure  accuracy.   Percentages  of  each  array  lying  within 
each  aet  of  limits  were  then  determined,  becoming  the 
figures  for  compariaon. 

For  conaiatency  of  rating,  within  Zb%   of  the  group 
mean  we  find  an  aTerage  of  38.2  percent  or  nearly  two  out 
of  five,  which  increaaes  to  64.9  percent,  nearly  2  out  5, 


•noo  otf  mm   alBt^a«  lo  ^tfln^q  ot  mm  immaam  »  d^tse   nl  Bbtm 
«X^   XX  «B9i>iws«zxJU>  ytjpflajftairtt  ;rjta»^Jt«#f»M0  o^  ^O'xtatfe 
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within  tlO%,  The  results  for  ovsrsll  group  socurscy  ar« 
soDewhst  lower f  ranging  froM  1  in  S  within  Zb%  to  nearly 
5  out  of  5  within  110^  of  the  oorreot«(S  mean. 

The  aTerage  range  of  the  ratings  of  pace  for  the 
whole  group,  still  based  on  100  as  standard,  is  found  to 
be  77  -  164,  exactly  a  2  to  1  spread.   The  aTerage  rating 
to  which  such  an  average  range  appliea  is  IIS  percent  of 
standard* 

It  is  felt  that  this  analysis  of  "current  practice" 
tine-study  rating  ahows  that  the  present  state  of  tiae- 
study  rating  is  not  up  to  the  level  required  for  the  wide* 
spread  confidence  and  acceptance  that  is  so  necessary  for 
its  use.   The  need  for  time  studies  and  their  proven  aid  in 
solving  many  complex  industrial  problesu  have  been  demon- 
strated for  many  years*  The  need  now  is  for  more  consistent, 
accurate,  and  reliable  ratings  of  pace  and  their  end  pro- 
duct, more  absolute,  trustworthy,  and  authoritative  atandard 
times* 


o^  hfurel  ti    ,&*xat)nA:>«;  «•  OCX  i\e  twtBCT  iiJC^t   «i)  .dar 
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AM  ANALYSIS  OF  CURRSMT-PRACTICE,  UNAIDED, 
TIME-STUDY  RATIHaS 

IMTFODDCTIOll 

*...tlM«  ■tud7*..ma7  be  defined  es  a  procedure  for 
determining  the  axiount  of  time  required,  under  certain  atan* 
dard  oonditiona  of  meaaurement,  for  taaka  inTolTing  aome 
hunan  aotlTity."^  The  end  reault  of  a  tiae  atudy  ia  the 
atandard  time  for  the  Job.   One  of  the  moat  common  typea  of 

time  atudy  la  the  atop-wateh  time  study,  by  far  the  moat 

a 
widely  uaed  aid  in  obtaining  a  atandard  time,   aa  defined 

by  Mundel:   ''A  atop-watoh  time  atudy  ia  uaed  to  find  the 
•mount  of  time  that  will  be  neoeaaary  to  perform  a  unit  of 
work,  uaing  a  given  method,  under  given  conditions  of  work, 
by  a  worker  poaaeasing  aufficient  akill  to  perform  the  Job 
properly,  aa  phyaioally  fit  for  the  Job  after  adjustment 
to  it  aa  the  average  p^^rson  who  can  be  expected  to  be  put 
on  the  Job  and  working  at  a  pace  100/130  of  the  maximm 
pace  that  can  be  maintained,  day  after  day,  without  harm- 
ful phyaical  ef f  ecta,  **^ 

It  ia  obvioua  that  it  would  be  mere  chance  to  find  a 


1.   M.  B.  Mundel,  Motion  and  Time  Study  Principlea  and 

practicea.  Mew  York,  Prentice-Hall,  inc.,  1960,  p.  1, 
(from  manuacript ) • 

£•   "How  They  Do  It",  Modern  Management,  Vol.  S,  Mo.  4, 
May  l^iF;  pp. "17-19. 

S.   M.  E.  Mundel,  *?yatematic  Motion  and  Time  Study.  New 
York,  Prentice-Hall,  Inc.,  1947,"T^  TB57 
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^tfq  etf  09  t9i9mqKB  sd  0*0  Mi»  oocsf^q  ej^i4»v«  viti  it*  ^1  cr# 

Mfi»tx*J«  ftrf*   lo  <v:r\oor    «riAiT   «    ^f*   T^rrf?(Tow  fsna    riot    ©rf^    f«> 


2. 

worker  satisfying  all  the  above  conditions  and  working  at 
such  a  standard  pace.   The  nechanics  of  ooMparlng  a  glTsn 
worker's  paoe  to  standard  pace  is  called  rating*   It  is  here 
that  the  rater* s  judgment  Must  play  an  laportant  part  as  no 
precise^  mathematical  way  of  comparison  has  yet  been  suc- 
cessfully devised*^'  ^  This  phase  of  time  study*  rating, 
should  be  the  strongest  link  in  the  chain  because  its  ys- 
racity  and  fairness  must  be  apparent  if  the  standard  time 
so  produced  is  to  be  accepted  with  trust  and  confidence  by 
all  concerned. 

There  are  many  systems  of  rating,  nearly  all  relying 
entirely  on  judgsMnt.   How  well  this  judgment  is  used,  i^at 
basis  it  rests  upon,  and  the  manner  in  which  it  takea  into 
account  the  ▼arious  factors  of  skill,  aptitude,  and  degree 
of  exertion  are  extremely  Important  quantities  In  making  a 
consistent,  reliable  and  fair  rating.   Many  systems  hsTe 
evolved  using  an  estimate  of  effort  to  which  individual 
company  fatigue,  personal  tisM,  tool  repair,  etc.  allow- 
ancea  are  added. 

The  actual  item  which  must  be  judged  is  pace  or  rate 
of  activity.   The  standard  rate  of  eotivlty  on  a  particu- 
lar job  is  chosen  as  that  pace  desired  to  be  maintained* 
There  are  many  numerical  designations  of  standard  pace 


4.   M.  S«  Mundel,  Op.  Clt.,  p.  165. 

6.   L.  P.  Alford  and  John  R.  Bangs,  Production  Handbook, 
New  York,  The  Ronald  press  Co.,  1947,  pp.  605-507. 
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Xct  •ayD'  9  boB   ttntn^   lUlrr  b9^qfiOom   96  ot  •!  6«ot^oifr  oc 

^liCi»<«   lis   til'  vai  "to   B«9;»6i^   ^ruiai  e««  e^»if9 

«  Jh  at  ae  ■{«   fr«l^'?s'ito  lo 
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-uoltfiaq  a   no  Y^*vi;Joa   lo   9:tw"i   biabna^a    '>rf?      ,y:*lT?.-*n«  lo 


•  arJJ  .:^l!^     .rr  r     ,^      ..-'        ,J, 


5. 

flueh  aa  60,  78,  80,  100,  120,  ato.   Faoh  haa  Ita  own  paouliar 
■•ana  of  manipulation  to  aasiat  in  arriTing  at  a  atandard 
tima* 

Juat  how  wall  induatry  ia  aeeoapliahing  tha  taak  of 
rating  ia  a  priaary  factor  in  the  entire  aueeaas,  accept* 
anca«  and  uaa  of  tine  atudy.   It  is  a  Matter  of  iaiportanoa 
to  management  and  labor  alike.   Aa  one  proadnent  trade 
unioniat  atatea  it:   "Thua  the  aolution  to  the  basic  problem 
of  the  Talidity  of  exiating  time  atudy  practice  liea  at  the 
▼ery  heart  of  aatiafactory  induatrial  relatione* "^  Thus,  in 
Juat  one  example  of  the  uaes  of  time  study,  management  and 
labor  bargaining  collectiTely^  auch  bargaining  should  not 
and  must  not  rest  on  a  chance  baaia  of  inaccurate  and  in- 
ept ratinga  and  their  attendant  poorly  allocated  standard 
timea.   Similarly,  the  many  other  uaea  of  time  studies  must 
not  rest  upon  any  insecure  or  wavering  baaia. 


6«  William  Oomberg,  A  Trade  Union  Analysis  of  Time  Study. 
Chicago,  Science  Reaearch  AasoeiateSf  197S,  p.  ife. 
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OBJECTIVE  AND  PURPOSB 

The  objootive  of  this  thesis  is  to  gather  and  array 
data  on  current  practice  time-study  ratings  in  such  a  Man- 
ner  that  will  permit  of  analysis  as  to  consistency,  accuracy^ 
and  amount  of  variation.   These  three  factors  in  the  rating 
of  job  pace  or  rate  of  actiyity  are  extremely  inqportant 
necessities  for  the  widespread  acceptance  of  and  confidence 
in  time  study  work.   Just  how  well  does  present  practice  of 
time  study  engineers  deserve  such  confidence  and  acceptaneeT 
It  ia  hoped  that  a  partial,  though  limited,  answer  to  this 
question  may  be  found  in  this  paper. 

Many  expArienced  time  study  engineers  hsTe  stated  that 

7 

estimates  of  pace  rarely  vary  more  than  five  percent.    How 

reliable  is  this  estimate  of  raters*  abilities?  Are  manage- 
ment and  labor  justified  in  taking  action  based  on  such  an 
•stimate  of  consistency? 

It  was  further  desired  to  ascertain  what  outstanding 
differences,  if  any,  might  be  found  with  regard  to  the  fol* 
lowing  parameters:   (1)  ynars  of  experience  of  the  rater; 
(2)  concept  of  standard  individually  used;  (3)  type  of 
training  initially  received;  (4)  sise  of  rater's  own  plant; 
(6)  geographic  area  in  which  the  rater's  plant  is  located; 
and  (6)  the  sise  of  town  or  city  in  which  the  individual 
rater's  plant  is  located.   Taking  into  account  the  region 


7.   Dale  Yoder,  personnel  Management  and  Industrial  Rela- 
tions ,  N ew  York,  Prentice-Hall,  Inc . ,1946,  p.  14S. 
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drawn  upon,  and  In  the  hope  of  moat  logically  unoovering  tha 
axlatanca  of  or  lack  of  any  dlffarr^neea,  tha  above  paraaetera 
ware  aubdlvidad  aa  followa: 

(1)  Yeara  Sxperlenoa 

(A)  leas  than  six  aontha 

(B)  6  montha  -  2  yeara 

(C)  2*4  yeara 

(D)  Bore  than  4  yeara 

(8)  Concept  of  Standard  Uaed  at  Plant 

(A)  your  own  concept  of  atandard  performance 

(B)  aome  fila  or  other  eBhodiment  of  atandard 
perfonoance* 

(5)  Initial  Time  Study  Training  Received 

( A )  Company 

(B)  College 

(4)  Sise  of  Plant 

(A)  0  •  200  employeea 

(B)  200  •  1,000  employeea 

(C)  over  1,000  employeea 

(5)  i'lant  Oeographlc  Location 

(A)  Northern  Midwest  (leas  Michigan) 

(B)  Central  Midweat 

(C)  Southern  Midweat 

(D)  Michigan 
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(6)   Sls«  of  Clt7»  Plant  Located  in 

(A)  0  -  6,000 

(B)  5  •  10  thousand 

(C)  10  •  25  thousand 

(D)  86  -  60  thousand 
(S)  60  -  100  thousand 
(F)  ovar  100,000. 
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rROCSDDRE  A 
FRKFARATIOK  FOR  AMD  RECEIPT  OF  RATHiOS 

Six  fllAs  wore  obtained  from  a  large  southern  Indiana 
industrial  eoncarn,   Baoh  fila  oonaistad  of  saTeral  oyolaa 
at  different  paces  of  a  particular^  actual  industrial  Job* 
After  a  careful  check  for  spurious  motions^  constancy  of 
pace^  and  of  cycle  times,  three  filn  loops  were  cut  froa 
each  filn.   These  eighteen  fila  loops,  (>ach  of  exactly  one 
cycle,  became  the  jobs  i^ich  were  to  be  rated*  Mo  f^lse 
experimental  conditions  are  thus  set  up  because  prerious 
research  has  shown  that  time  study  engineers  can  rate  pace 
from  films  or  by  actually  obserYing  the  worker  with  prac* 
tioally  equal  facility*®  These  Jobs  covered  the  range  from 
simple  finger,  hand,  and  arm  movements  of  light  aasembly 
and  inspection  to  the  gross  body  movements  used  in  load- 
ing and  operating  a  large  forming  press* 

The  next  necessary  component,  the  raters  themselves, 
were  the  participants  at  the  Fifth  Annual  Motion  and  Time 
Study  Work  *!es8ion  (1950  session)  held  at  thla  university* 
These  seventy-two  raters  were  from  throughout  the  Middle 
Vest  and  nearly  all  were  actively  engaged  time  study  engine- 
ers* 

A  short  briefing  of  the  assembled  engineers  was  made 
prior  to  th''  showing  of  the  films*   It  was  emphaalESd  that 


8*   M.  K.  Mundel  and  L.  R.  Margolin,  Report  of  the  Fourth 
Annual  Motion  and  Time  Study  Work  Session,  Purdue  Univ., 
1940. 


V-'       t  ^(  y"  i; 


•tfot    imit:t tubal  iaiyioa    ,i#ilyoldf«q  «  lo  ««»«cr  c^flAialtlJ^   t9 

■•^1  aua  319W  aqocii  iaiX .      r>  :!;;    ,8»«1:»  •X5t9  "io  ba«    «»oaq 

•no  t^<^c^*x»  lo  d«si»    ,aqa«X  iaXll  floeirigl*  eBsdT     .«xn  lioiio 

©R  f-1   o/!      .b©*a«T  »d  o:r  stn*  r^^fi*,  atfot  8i»  MttOftd   ,*Xo^o 

•d«q  »**^t  HAD  8i«*alBa'«  x^^  •«1*  *iiri*  flwori«  ftsii  ti9%M9M9i 
•Q&iQ  rfctlw  T<*3liow  *>ri3   ^(ixTi*ado  ^XXau^oa  \;d  'to  aaiill  n<nt 

i:id«d«««  ^i!f9iX  to  BiitaiMTaa  s^a  bn©   ,basxl   »       all  •Xcynls 
'b&ol  ni  b9Bis  e:Jn©««vow  vhod  aao^    -K.-»    otf  noi^o*q»«l  bita 

.es«iq  ^niarxol  es-mX  «  anl*«i«q0  fens   }^al 

«««vX»8S«d;t  «i»;>isi    >rf;t    ^ia^moomoo  x*t»nm«»9n  txmn  mtVf 

ejirp  ?>ng   rr)f:?ft5«    rn,rr.vv,i    ,^*'«^^«   ^i^^   ^,  •iTatqXoli'wq   sd*   •iiaw 

.^jiatevxiur  aXi\5   tfa  J&X#d   ,;iso  oaeX)   ifoiea^r   afio??  x^^ir^e 

eXbl;}!!  ad^  iuodwroiri*  monl  •tew  ••x*itm  owcf-^cTnev^e    f^ssdT 

«B^e 
tkd^  b«Mt9Mti<9if  ft^w  ;tl      •naXll   adjT    1...  ^.^^yna    say   qs   -loxiq 


the  Tarlout  jobs  and  pao«a  of  these  jobs  were  to  be  rated 
exactly  as  if  they  were  occurring  and  being  rated  in  the 
r»tT*  B   own  plant.  Ratings  were  assigned  aocording  to  the 
rater's  own  company  standard  and  company  policies  and  were 
then  converted  to  a  coaaon,  comparable^  numerical  basis  by 
each  individual  rater.   The  comawn  basis  selected  was  the 
100  standard-130  maximum  non-harmful  phyaical  effort  defi- 
nition.  The  raters  were  furniahed  a  simple,  arithmetic 
oonversion  table  to  convert  their  own  rating  scale,  no  mat- 
ter what  standard,  to  this  scale. 

The  work  session  was  cautioned  not  to  rate  the  method, 
to  assume  the  method  used  the  best  for  the  particular  job 
in  question.  Mo  method  variations  were  given  on  any  of  the 
jobs  and  the  raters  were  told  to  aasume  that  work  of  ac- 
ceptable quality  accompanied  each  of  the  eighteen  perform- 
anoes. 

The  assemblsge  was  further  cautioned  that  although 
there  were  three  paces  each  of  six  different  actual  indus- 
trial jobs,  there  was  no  set  ratio  between  paces  on  the 
same  or  different  jobs;  and  that  the  three  paces  of  each 
job,  themselves,  might  bo  practically  the  same  or  quite 
different. 

Finally  the  films  were  shown,  and  in  an  entirely  ran- 
dom order  so  that  no  set  sequence  of  pace  or  job  could 
possibly  influence  the  raters.   Although  shown  in  random 
order,  the  films  are  numbered  consecutively  from  one  to 
eighteen  in  this  paper,  each  three  numbers  in  order 
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referring  to  the  three  peoes  of  a  pertleular  Job. 

The  InforMAtion  enabling  the  breakdown  of  the  aiz 
major  oategoriea  Into  their  aeveral  aubdlvlalons  waa  ob- 
tained from  peraonal  data  queatlonnalrea  filled  out  prior 

Q 

to  the  ahovlng  of  the  fllas. 

At  thla  point  it  la  dealred  to  atate  that  the  Manner 
in  which  the  ratinga  were  recorded  and  tabulated  haa  such 
to  do  with  the  aise  and  aoope  of  the  analyaea  of  thla  work. 
Bach  rater  placed  hi  a  converted  ratings  on  an  IBM  mark* 
aenaing  card  which  then  later  was  pxinched  and  uaed  to  aaaiat 
in  tabulating  the  reaults.   The  faollitj  with  v^lch  the 
▼arioua  ratinga  and  parameters  could  be  entered  on  these 
carda^  the  apeed  and  accuracy  of  aaaembling  all  or  any  sag* 
■ent  of  the  data  by  any  particular  parameter  or  aubdiviaion, 
and  the  ooaq^lete  tabular  arrays,  all  produced  by  the  vari- 
ous IBM  equipments  are  an  outstanding  addition  to  this  type 
of  research.   Long,  tedious  hours  of  data  aasemblage  and 
arraying  became  ahort  minutea  to  the  electronic  "mind*. 


9.   Bernard  S.  Borrua,  The  Preaent  State  of  Time  Study. 
Theaia,  Manuacript,  Purdue  Univ.,  June,  1960. 
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PROCBDORB  B 
A88BHBLY  AKD  COMPUTATION  OP  DATA 

A  logical  division  of  tha  procedure  occurs  at  this 
point.   The  first  phase  included  the  preparation  for  and 
the  receipt  of  the  ''current  practice"  ratings  of  pace  by 
the  group  of  tlae  study  engineers*   The  second  phase  con- 
sists of  the  proper  assemblage^  Bianipulatlony  and  ooiiq;}uta- 
tlon  of  the  data  necessary  to  fom  the  basis  for  any  pos- 
sible results  and  conclusions. 

The  individual  ratings  assigned  to  a  particular  film 
were  next  arrayed  for  the  whole  group  (all  72  raters)  and 
by  the  various  subdivisions  of  the  six  paraaieters*   For 
each  array^  the  average  or  arithmetic  mean  was  determined 
as  the  initial  basis  for  comparison.   Consistency,  the 
analysis  of  which  was  one  of  the  primary  objectives,  is 
the  measure  of  how  the  individual  ratings  of  a  given  array 
ere   grouped  about  its  arithmetic  iMian. 

However,  to  call  this  '^average  rating"  the  actual  or 
true  rating,  even  though  it  is  the  concensus  of  opinion  of 
72«odd  professional  time  study  men,  would  be  an  untenable 
assumption.   Much  previous  information  on  the  subject  has 
determined  a  general  tendency  to  rate  the  slower  paces  too 
high  and  the  more  rapid  paces  too  low*^^  Therefore,  a 
corrected  mean,  or  rather,  a  best  available  approximation 
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of  the  correct  mean  rating,  was  computed  with  the  aid  of  a 
preclae  knowledge  of  the  ratios  between  cycle  times  for 
each  of  the  three  paces  on  a  given  Job.   A  consistent  series 
based  on  the  actual  cycle  times  for  each  pace  was  obtained 
for  each  of  the  six  different  Jobs.  The  consistent  series 
was  adjusted  by  a  single  factor  so  that  when  this  series 
and  the  sTerages  of  the  Individual  ratings  In  each  array 
on  each  job  were  then  plotted^  the  sums  of  the  squares  of 
their  deviations  about  YsX  were  a  minimum.   A  value,  so 
obtained,  thus  becomes  the  best  approximation  of  the  cor- 
rect mean  rating,  hereafter  referred  to  as  the  corrected 
mean.   Accuracy,  whose  analysis  was  another  primary  objec* 
tlve.  Is  the  measure  of  how  the  Individual  ratings  of  an 
array  are  grouped  about  Its  corrected  mean. 

It  Is  apparent  that  the  term  "array"  has  assumed  an 
ever*lncreaslng  Isiportance  In  this  paper,  reoocurrlng  most 
frequently*  To  yield  a  clearer  picture  of  what  Is  refer- 
red to  when  this  word  appears,  the  following  Is  offered  In 
explanation.   The  ratings  for  a  particular  pace  by  a  par- 
ticular subdivision  of  a  parameter,  such  as  "2  -  4  years'* 
of  *^ears  Sxperlence**,  are  arranged  from  lowest  to  highest* 
This  Is  an  array.   For  each  array  the  range,  lowest  sub* 
tracted  from  the  highest  rating;  the  arithmetic  mean,  the 
corrected  mean,  and  various  groupings  about  thase  means 
may  be  easily  computed.   The  Importance  of  arrays  In  this 
work  may  be  further  emphasized  by  the  quick  calculation 
that,  having  eighteen  paces  and  twenty-two  subdivisions  of 
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parasetera,  a  reaultant  396  arrays  mxat  naoaaaarily  ba  ar- 
ranged and  manipulated* 

In  order  to  carry  out  the  other  obJeotiTea,  It  be- 
ooaea  neoeaaary  to  find  an  additional  baaia  for  eoapariaon 
between  the  varioua  paraneter  aubdlTlalona.   Thia  baala  to 
be  capable  of  conaolidation  of  mch  bulk  into  a  few  atatis- 
ties  that  will  submit  to  further  analyaia*  Thua,  for  each 
array,  liaita  were  set  up  at  the  lb%,   l'fi%»   llO^«  and  the 
^20^  leTels  about  the  actual  veana  to  indicate  oonparative 
conalstenoy  of  rating,  and  aiailar  limit  a  were  aet  about 
the  corrected  m^ana  for  an  indication  of  oon^arative  ac- 
curacy.  Percentages  of  each  array  lying  within  each  aet  of 
limits  were  then  determined  and  are  tabulated  in  the  yari* 
oua  Tables  in  the  Appendix.   The  aTerage  percentage  for 
each  group  alao  appears. 

Reference  to  any  of  the  Tables  mentioned  above  will 
show  quite  wide  Tariationa  in  percentages  between  the 
various  aubdl visions  of  a  parameter.   The  next  step  was 
to  determine  if  any  statistically  significant  differencea 
actually  existed.   A  standard  P  test  was  made  for  aignifi- 
oant  differencea  at  either  the  5  or  1  percent  confidence 
level a  between  mean a  within  a  parameter.   For  those  that 
indicated  a  difference  in  meana  greater  than  could  be  ex- 
pected by  chance  alone,  Fiaher  t  teata  between  all  com- 
binations of  pairs  within  a  parameter  were  made*  Results 
of  the  t  test  at  the  6%   level  indicated  a  reasonable  doubt 
that  the  differences  between  two  mf^ana  could  be  due  to 
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chance  alone;  while  result ■  at  the  1%   lerel  Indicated  quite 
probably^  i.e.^  99  tiuias  out  of  100^  that  the  differences 
were  due  to  sosie  factor  other  than  chance*  The  results  of 
both  the  F  and  t  tests  appear  in  Tables  24  and  26  respec- 
tively. 


.«x 


miXuyi  bp^A&lbaX   xevex  Xi.  903   3a  !t7;Lx;i'>      .irriw    ^onola   ooxusoo 


14. 
XSSULTS 

Probably  the  most  important  results  appear  in  Tables 
1  and  8  of  the  Appendix.   These  portray  the  Tarioua  find- 
ings for  the  work  session  taken  as  a  whole.   For  consis- 
tency of  rating^  within  Z^   of  the  group  Mean  we  find  an 
•▼erage  of  S8.2  percent «  or  nearly  two  out  of  five^  which 
increases  to  64*9  percent,  nearly  2   out  of  S,   within  llO^. 
The  ro8\U.t8  for  overall  group  accuracy  are  somewhat  lower, 
ranging  froB  1  in  S  within  the  tb%   linits  to  nearly  S  out 
of  5  within  110^  of  the  corrected  mean. 

The  average  rtmge  of  the  ratings  of  pace  for  the 
whole  group,  still  based  on  100  as  standard,  appears  in 
Table  g  as  77  -  154,  exactly  a  2  to  1  spread.   The  average 
rating  to  which  such  an  average  range  applies  is  113  per- 
cent. 

Also  found  in  Table  2  are  the  eighteen  arithmetic  and 
corrected  means  and  the  variations  between  each,  ranging 
from  0  on  film  15  to  12.9;C  on  film  9,  showing  an  average 
variation  of  6.2^. 

Tables  3  through  23  show  the  percentages  within  the 
limits  of  their  respective  means  for  the  various  subdivi- 
sions of  the  six  parameters.   From  these  tables,  with  the 
aid  of  Tables  24  and  25,  the  following  statistically  sig- 
nificant differences  between  means  are  foundt 

Initial  Training.   Between  "Company"  and  '^College* 
for  both  consistency  and  accuracy. 
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Area.   Betweon  Michigan  and  all  other  groups  In  oon- 
aistancj  only. 

31 £a  of  City.   Between  over  100,000  and  all  other  group a 
in  conaiatency  only. 

Between  5  -  10,000  and  all  groups  but 
0  -  6,000  in  conaiatency. 

Between  0  -  6,000  and  26  -  60,000  in 
conaiatency. 

Because  of  the  induatry,  attitude,  and  whole-hearted 
cooperation  of  thA  Beabera  of  the  1960  work  aeaaion,  it 
la  believed  that  the  reaults  and  data  coapiled  in  thia 
theaia  are  probably  repreaent&tive  of  tiaie  atudy  practice 
in  the  Middle  Vest  area. 
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16. 
CONCLUSIONS 

1.  The  promise  that  tine  study  engine tre«  rating i 
of  paee  rarely  vary  aore  than  6  percent  Is  not  borne  out* 
Only  36*2  percent  of  the  work  session  were  within  Z^%»   and 
no  subdivision  had  aore  than  66.7  peroent  within  these 
Halts  of  Its  aean. 

2.  The  average  range  of  77  -  164  on  an  averac*  pae« 
of  115  percent  appears  excessive  In  that  all  raters  were 
viewing  the  saae  fllas  at  the  saaie  tlise*   However,  It 
should  be  pointed  out  that  89.7  percent  of  the  whole  group 
were  within  l20^,  yielding  a  range  of  90  •  136  (about  113) 
In  which  9  out  of  10  raters  are  found. 

5*  The  group  as  a  whole  exhibited  a  marked  tendency 
to  rate  the  faster  paces  more  consistently  than  the  slower* 
On  the  slowest  pace  shown  (film  4  -  97  percent)  only  17 
percent  of  the  work  session  participants  were  within  tb% 
of  the  mean  rating^  while  on  a  typical  faster  pace  shown 
(film  12  -  134  percent)  a  total  of  63  percent  were  within 
Zb%   of  the  me^an.   This  effect  continued  with  only  46  per- 
cent of  the  group  within  .lO^t  of  the  mean  rating  on  the 
slowest  while  81  percent  were  within  these  limits  of  the 
mean  rating  on  the  faster  pace* 

4*  Throughout  the  analysis,  accuracy,  or  grouping 
about  the  best  available  estimate  of  the  correct  pace,  was 
slightly  Inferior  to  consistency  (the  grouping  with  re- 
spect to  the  arithmetic  mean  pace)* 
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8.  Also  apparent  In  the  iiany  arrayi  is  the  praTlous* 
Ij  sentioned  **r«grassion"  tandaney  to  rata  the  lowar  pacaa 
too  high  and  the  higher  paces  too  low, 

6.  Vo  significant  diffnrancaa  at  tha  b%   oonfidanca 
laval  batwaen  the  Tsrloua  subdivisions  of  tha  £X?ERISMCS, 
CONCEPT  OP  STAMDARD,  and  UVUBm   OP  SMPLOYKES  catagoriea  la 
found.  Howavar,  it  is  dasirad  to  point  out  that  a  eoapari- 
son  of  Tables  7  and  8  will  show  that  tha  raters  having  a 
"Pilm  or  other  embodiment  of  standard**  concept  are  both 
■ore  conaiatant  and  mora  accurate  within  all  rating  error 
limit  groups,  having  percentage  pluralitiea  ranging  up  to 
11  percent. 

7.  Significant  differences  betwaen  maana  eziated  at 
the  5^  confidence  level  (1  time)  and  at  the  1^  level  (5 
timaa)  for  consistency  between  "Company**  and  "College" 
under  category  INITIAL  TRAIKIMO  (see  Table  26).   In  each 
instance  "College"  is  lower  than  ''Company"  when  comparing 
actual  percentage  meana.   It  is  not  believed  that  the  in- 
ference that  receiving  initial  time  atudy  training  in  col- 
lage is  inferior  to  company  initial  training  can  be  sua- 
tained  from  this  one  category  breakdown  analysis,  but 
rather  that  the  poasibla  interaction  of  other  parameters 
auch  as  yeara  of  experience,  sise  of  group,  etc.  have 
played  an  important  part  in  yielding  these  reaults. 

8«   Under  the  ARBA  parameter,  significant  differences 
at  the  1^  confidence  level  were  found  between  "Michigan" 
and  all  other  subdivision a  for  all  groupinga.   Rafaronca 
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to  the  tables  of  eotual  percentage  aoans  ihows  "Michigan" 
poaseasing  Markedly  lower  averagea  throughout.   UoweTer^ 
the  results  here  are  not  an  indictment  of  the  whole 
"Miohigan*  area  as  the  saaple  alee  of  only  nine  aen  ia  very 
•Mall  and  two  of  this  subgroup  assigned  extremely  high 
ratings  throughout  the  entire  eighteen  filMa* 

9«  Under  SIZE  OF  CITY  the  raters  froM  "Over  100,000" 
are  significantly  and  oonfiiatently  below  all  other  groups* 
Likewise  are  the  '*5  •  10,000"  raters  below  nearly  all 
others.  Agoin,  it  i  s  believed  that  probably  the  extremely 
8MalI  saa^jle  sizes  of  these  two  gz^iupa  and  the  interaction 
of  other  factors  preclude  the  definite  conoluaion  that  in- 
ferior ratings  correlate  with  such  sixes  of  cities. 
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19. 
ZIPBRBMCBS 

1.  It  Is  felt  that  this  analysis  of  "current  prao- 
tlea"  tlna-study  rating  shows  that  tha  praaant  atata  of 
tlma- study  rating  Is  not  up  to  the  ISTsl  required  for  the 
widespread  confidence  and  acceptance  that  Is  so  necessary 
for  Its  use.   The  need  for  time  studies  and  their  proven 
aid  In  solving  many  oonrplcx  Induatrlal  problems  have  been 
deaonstrated  for  many   yeara.   Tha  need  now  la  for  wotb   oon- 
■latent,  accurate,  and  reliable  ratlnga  of  pace  and  their 
end  product,  more  abaolute,  trustworthy,  and  authoritative 
standard  times. 

2.  perhaps  the  single  most  Important  Inference  that 
can  be  gained  from  this  analysis  Is  that  there  ezlate  an 
urgent  need  for  removing  or  mlnladBlng  the  peraonal  "Judg- 
ment** factor  from  the  Individual  rating.   The  wide  ranges 
of  ratings  when  viewing  the  same  rates  of  activity  must  be 
lessened  If  we  are  to  aohlev€>  more  consistent  ratings. 

The  use  of  different  concepts  of  standard  pace  and 
the  reliance  on  personal  judgment  must  be  minimised.   In 
other  worda,  a  more  concrete  basis  must  be  found  for  the 
rating  procedure.   It  la  believed  that  the  exception  noted 
under  Specific  Conclusion  6,  while  not  conclusive  In  It- 
self ^  points  the  way  to  poaalble  ultimate  reduction  to 
Inalgnlfleance  of  the  judgment  factor*   It  Is  suggested 
that  the  use  of  a  film  ahowlng  a  atandard  rate  of  activity 
or  varloua  peroentagea  thereof,  ahown  adjacent  to  or 
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superiapoaed  upon  a  flla  of  th«  pao«  desired  to  be  rated 
can  result  in  mich  more  oonsl stent «  accurate,  and  reliable 
ratings  of  pace  by  glTlng  the  rater  a  visible,  concrete 
basis  on  which  to  exercise  the  then  modicua  of  personal 
judgment  required.   While  this  procedure  aay  not  be  ec- 
onomically feasible  for  the  inaking  of  all  Job  pace  rating s, 
a  judicious  use  of  such  a  procedure  should,  in  all  prob- 
abilities, result  in  a  definite  sdnimizing  of  the  Judgment 
factor* 
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Table  1 

WTIRE  GROUP  -  72  RATERS 

Coneistenoy 

PI  In 

Arithmetlo 

Percent  of 

Qroup  Within 

NO. 

Mean  R&tlng 

t5jr        :7ijf 

110% 

120% 

1 

111 

29        51 

58 

87 

8 

112 

41        57 

71 

88 

f 

110 

58        51 

60 

88 

4 

97 

18        55 

48 

84 

• 

lis 

52        58 

54 

88 

• 

156 
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76 

95 

? 

101 

51        45 

59 

90 

• 

107 
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65 

88 

9 

101 
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47 

78 

10 

110 

40        51 

69 

91 

11 

118 

55        56 

65 

94 

12 

154 

55        65 
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15 
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68 

95 

14 

115 

44        55 

68 

90 

15 

114 

45        51 

66 

94 

16 

112 

55        64 

74 

90 

17 

117 

40        61 

69 

95 

18 

117 

61        72 

78 

95 

Average 

58.2      55.2 
Accuracy 

64.9 

89.7 

Film 

Corrected 

Percent  of 

Oroup  Within 

ho. 

Mean  Rating 
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XlOjf 
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29        45 
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82 
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Table  2 
COMPARISOM   OF  BMTIRE  OROUF   UTSkUS  AND  RAMOB 


Ai*ithBetio         Corrected         Percent 


FllK  KO. 

Range 

Mean  Rating 

Hean  Ratinjc 

Variation 

1 

65 

- 

156 

111 

104 

6.7 

• 

70 

•• 

149 

112 

105 

6.7 

1 

66 

- 

161 

110 

102 

9.8 

4 

62 

«• 

143 

97 

87 

11.5 

• 

76 

- 

162 

113 

lu9 

3.7 
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65 

«» 

169 

136 
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5.5 
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Tabl«  3 

BXPKRIBMCB 
LESS  THAN  6  MONTHS  -  6   RATOIS 


24, 


Consistency 

riim 

Arlthmetio 

percent  of 

Group  Within 

NO. 

Mean  Rating 

tb% 

^•'W 

lioji 

220;f 

X 

107 

33 

67 

67 

100 

8 

114 

33 

67 

67 

67 
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107 

33 
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60 

83 

4 

100 

0 

0 

0 

60 
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116 

17 

17 

60 

83 
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128 

17 

60 

67 

88 

T 

97 

33 

33 

60 

83 
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106 

33 

60 

60 

83 

• 

92 

60 

60 

67 

100 

10 

113 

17 

17 

17 

100 

11 

109 
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83 
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12 
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17 

33 

67 
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18 

110 

83 

60 

67 
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14 
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33 

67 

83 
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16 

116 

60 

60 

67 

100 

16 

118 

38 

67 

67 

100 

17 

114 

67 

67 

67 

100 

18 

114 

60 

67 

83 

100 

ATeragt 

33,3 

49.2 

60.3 

90.7 

Accuracy 

Plla 

Corrected 

Percent  of 

Group  Within 

NO. 

Maan  Bating 

16;C 

-7*^ 

:ioj^ 

l20f 

1 
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60 

67 

67 

83 

• 

104 

17 

33 

33 

67 

9 

120 

17 
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60 

83 

4 

67 

17 
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38 
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33 

33 

S3 
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60 
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7 
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Table  4 

BXPERIBMCS 
6  MONTHS  -  2   YEARS  -  16  RATERS 


S5. 


Conalatenoy 

PilM 

Arithaetio 

?arcant  of 

Oroup  Within 

NO. 

Mean  Rating 
112 

44 

76 

110% 
76 

220^ 

1 

94 

8 

114 

44 

56 

81 

94 

9 

111 

57 

66 

65 

94 

4 

98 

19 

51 

60 

94 

§ 

118 

26 

51 

69 

94 

• 

168 

60 

69 

69 

86 

T 

104 

25 

65 

69 

88 

i 

109 

44 

66 

65 

94 

9 

101 

26 

58 

60 

88 

10 

112 

25 

51 

60 

88 

11 

117 

58 

69 

69 

94 

12 

157 

44 

66 

81 

94 

19 

116 

26 

65 

65 

94 

14 

116 

51 

44 

65 

88 

16 

116 

66 

66 

81 

88 

16 

113 

51 

44 

65 

100 

IT 

117 

26 

50 

60 

94 

18 

116 

50 

63 

78 

94 

Averaga 

56.4 

62.8 

66.8 

92. 

Avaraga 

PllM 

Corraoted 

Paroant  of 

Group  Within 

Mo. 

Mean  Rating 

Uf 

27*^ 

iioje 

220;t 

X 

106 

60 

65 

65 

94 
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57 

60 

66 

94 
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Table  5 

hpirience 

2  YEARS   -   4  YEARS   -    19   RATERS 


Conaistency 

PllB 

Aritbnetio 

Percent  of 

Oroup  within 

MO. 

M«an  Rating 

is;f 

t74^. 

Iio;^ 

?»* 

1 

111 

42 

47 

47 

68 

8 

113 

60 

50 

88 

94 

S 

109 

44 

69 

69 

100 

4 

96 

19 

19 

25 

76 

• 

111 

26 

60 

56 

100 

• 

1S6 

68 

68 

84 

100 

t 

100 

19 

25 

56 

88 

• 

104 

26 

66 

81 

88 

9 

106 

32 

37 

68 

90 

10 

108 

60 

56 

81 

100 

11 

120 

47 

47 

63 

100 

12 

134 

74 

79 

100 

100 

IS 

116 

63 

68 

84 

100 

14 

112 

60 

75 

81 

100 

16 

109 

38 

44 

50 

100 

16 

110 

74 

84 

90 

96 

17 

118 

47 

74 

96 

100 

18 

118 

63 

79 

84 

96 

Avoraga 

46.0 

57.1 

71.8 

93. 

Aoouraoy 

FlllB 

Corrected 

Percent  of 

oroup  Within 

Mo* 

Mean  Rating 

t^f 

Vf^ 

2lO;t 

120^ 

1 

104 

42 

47 

47 

68 

8 

106 

37 

60 

63 

88 

S 

122 

19 

44 

63 

81 

4 

87 

6 

6 

19 

56 

• 

109 

38 

44 

56 
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• 

143 

42 

47 

84 
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7 

90 

26 

25 

31 

60 

• 
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25 

38 
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94 

9 

116 

26 

26 

53 

79 

10 
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44 

63 

75 
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11 

112 

26 

42 

53 

84 

12 
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21 

42 

90 

100 

IS 

107 

38 

42 

58 

90 

14 
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50 

69 

75 
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16 
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31 

44 

56 
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16 

107 

63 

74 

90 

96 

17 
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58 
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84 
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18 
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90 
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Tftbl«  6 

IXFS31IEMCE 
MORB  THAN   4   YEARS  -    29   RATERS 


27. 


Con 

slatency 

PllM 

Arithnetlo 

Percent  of 

Oroup  Within 

MO. 

Mean  Rating 

tbf 

I^i^ 

:io^ 

180^ 

I 

109 

51 

41 

62 

90 

8 

109 

54 

61 

82 

96 

8 

106 

39 

60 

67 

95 

4 

99 

45 

64 

61 

95 

• 

106 

52 

46 

61 

89 

6 

133 

46 

56 

76 

95 

t 

100 

52 

64 

67 

95 

• 

106 

59 

60 

68 

95 

9 

98 

24 

51 

56 

88 

10 

107 

56 

67 

71 

95 

11 

116 

58 

65 

79 

90 

12 

132 

62 

69 

72 

90 

15 
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62 

56 

69 

97 

14 

111 

39 

46 

68 

89 

16 

114 

45 

64 

71 

96 

16 

110 

46 

62 

69 

95 

17 

116 

48 

69 

72 

86 

18 
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69 

72 

85 

95 

Average 


42.1 
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Accuracy 


Film 

Corrected 

Percent  of 

Oroup  Within 

No. 

Mean  Rating 

tb% 

:74jr 

lio% 

120^ 
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54 

45 
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8 

105 
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61 
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Table  7 

COMCBPT  OF   v^AMDARD 
Omh   CONCEPT  -  54   RATFRS 


86. 


(^oni 

siatency 

FllB 

Arithmetic 

Percent  of 

Oroup  Within 

No. 

Mean  Rating 

152 

iTii 

;io^ 

i29% 

1 

110 

50 

56 

61 

89 

8 

115 

46 

50 

84 

90 

3 

109 

56 

54 

60 

92 

4 

96 

24 

SO 

42 

76 

5 

118 

48 

44 

58 

92 

6 

154 

44 

56 

70 

95 

7 

108 

38 

56 

60 

90 

8 

107 

40 

46 

68 

90 

9 

101 

50 

41 

88 

85 

10 

110 

88 

50 

58 

90 

11 

117 

52 

61 

72 

95 

12 

154 

46 

65 

82 

94 

15 

115 

41 

61 

72 

96 

14 

112 

40 

54 

66 

90 

15 

114 

58 

46 

60 

94 

16 

111 

57 

74 

78 

95 

17 

117 

59 

65 

72 

91 

18 

117 

54 

74 

80 

96 

Average 

40.5 

54.4 

66.4 

90.8 

Aocuraoy 

FllB 

Correoted 

Percent  of 

Oroup  Within 

No. 

ll*an  Rating 

m 

;7tf 

ZlOf 

120% 

1 

105 

26 

41 

48 

87 
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105 

40 

54 

58 

86 

5 

122 

24 

SO 

48 

82 

4 

86 

20 

52 

44 

68 

5 

108 

52 

48 

64 

92 

6 
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41 

46 

72 

91 

7 

89 

16 

28 

46 

66 

8 
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28 

56 

56 

86 

9 

115 

15 

82 

59 
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10 
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58 
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11 
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12 
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41 
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96 

IS 
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60 
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Table  8 

COMCBPT   OF  STAliDARD 
FILM  OR  OTHER   BMBODIMBMT   -   15   RATERS 


Consistenoy 

Film 

ArlthBotio 

percent  of 

Group  Within 

MO. 

Moan  Rating 

:5;r 

274?f 

210^ 

22o; 

1 

112 

7 

47 

53 

100 

• 

107 

55 

85 

75 

100 

i 

109 

47 

55 

75 

100 

4 

96 

27 

55 

67 

100 

• 

111 

20 

47 

60 

100 

• 

158 

60 

80 

100 

100 

T 

101 

7 

40 

60 

100 

• 

107 

55 

60 

67 

100 

f 

100 

27 

80 

47 

95 

10 

109 

65 

60 

75 

95 

11 

116 

53 

55 

75 

100 

12 

134 

67 

80 

93 

100 

15 

114 

60 

67 

80 

100 

14 

115 

55 

80 

100 

100 

15 

112 

60 

95 

95 

100 

16 

112 

27 

60 

80 

100 

17 

116 

65 

67 

75 

100 

18 

114 

73 

80 

100 

100 

Average 


42.2 


61.8 


75.8 


99.2 


Accuraoy 


PllK 

Corrected 

Percent  of  Oroup  within 

Kc« 

Mean  Rating 

tb% 

17i%              110% 

220] 

1 

102 

55 

55        60 

67 

a 

104 

55 

47        67 

100 

$ 

120 

15 

55        60 

95 

4 

87 

40 

40        47 

80 

• 

110 

47 

47        60 

100 

• 

144 

55 

73        93 

100 

T 

69 

55 

47        47 

55 

• 

100 

20 

65        67 

95 

9 

116 

20 

27        47 

67 

10 

105 

47 

55        60 

87 

11 

111 

87 

55        60 

87 

12 

142 

65 

55        80 

100 

13 

107 

20 
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95 

14 

118 

60 

60        75 
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15 

112 

60 

95        95 

100 

16 

106 

55 

67        67 

95 

17 

114 

65 

67        75 

100 

18 

114 

75 

80       100 

100 

Average 


42.1 


55.9 


67.1 


89.6 
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Tftbl«  9 

IKITIAL  TRAINIMO 
BY  COMPAIJY  -  46  RATBRS 


90, 


Conaistenoy 

FllM 

Arithmetic 

percent  of 

Group  Within 

Mo. 

Mean  Fating 

tb% 

IJi^ 

:io^ 

I20f 

1 

112 

29 

51 

58 

89 

t 

114 

51 

76 

85 

90 

a 

110 

44 

61 

73 

95 

4 

97 

22 

37 

44 

88 

e 

lis 

37 

46 

63 

93 

• 

134 

68 

73 

89 

96 

? 

103 

27 

49 

56 

90 

8 

109 

56 

68 

78 

90 

9 

103 

20 

40 

49 

89 

10 

112 

44 

63 

63 

93 

11 

118 

38 

58 

71 

98 

18 

136 

53 

67 

84 

96 

13 

109 

47 

71 

87 

98 

14 

121 

54 

61 

78 

93 

15 

115 

46 

56 

78 

95 

16 

112 

44 

78 

84 

93 

17 

lie 

47 

73 

87 

98 

18 

118 

68 

82 

84 

93 

Average 


43.0 


61.6 


72.8 


93.1 


Acouraoy 


11« 
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Percent  of 

Oroup  Within 

ho. 

Mean  Rating 

^^f 

274;c 

2io;i 

120^ 
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105 

45 

47 

60 
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107 

41 

54 

66 

90 
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127 

20 

32 

49 
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87 

22 

29 

59 

68 

• 

109 

37 

51 

63 

93 
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143 

44 

61 

76 

96 

7 
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27 

49 

56 

90 
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102 

32 

68 

78 

90 

9 

118 

16 

40 

49 

89 

10 

106 

32 

51 

66 

90 

11 

115 

42 

49 

69 

93 

18 

144 
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67 

98 

13 
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58 

69 

93 

14 
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54 

54 

63 
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15 
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95 

16 
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Tabl«  10 

IMITIAL  TRAINIMO 
IB  COLLEdS  -  22  RATERS 


Consiatenoj 

Flln 

Arithmetic 

Percent  of 

Group  Within 

Mo, 

M«an  Rating 

t6jf 

i'ri% 

110% 

120% 

1 

111 

45 

45 

68 

91 

t 

111 

32 

45 

41 

82 
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111 

41 

41 

45 

82 

4 

98 

18 

32 

60 

88 

• 

116 

9 

52 

46 

88 

• 

142 

45 

64 

73 

82 

▼ 

101 

36 

50 

69 

91 

• 

106 

27 

41 

66 

86 

• 

99 

32 

32 

64 

66 

10 

110 

32 

41 

50 

91 

11 

116 

32 

56 

55 

86 

12 

156 

45 

66 

77 

91 

IS 

116 

23 

32 

50 

86 

14 

114 

55 

59 

68 

91 

16 

116 

41 

45 

64 

91 

16 

113 

32 

36 

55 

66 

17 

117 

32 

45 

68 

91 

18 

116 

16 

59 

§± 

96 

Average 

34.5 

45.6 

58.3 

67.1 

Accuracy 

Film 

Corrected 

Percent  of 

Group  Within 

Mo. 

Mean  Rating 

t&f 

^Hi 

IlO^ 

220Jf 

1 

104 

36 

36 

50 

82 
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106 

36 

45 

45 

73 

8 

122 

18 

41 

60 

73 

4 

89 

23 

36 

45 

77 

6 
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27 

41 

45 

82 

6 

149 

41 

55 

55 

82 

7 

89 

14 

32 

45 

64 

8 

106 

27 

41 

56 

86 

9 

114 

18 

18 

36 

64 

10 

104 

32 

36 

60 

91 

11 

118 

23 

60 

59 

82 

12 

144 

27 

50 

64 

91 

13 

109 

18 
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14 
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56 
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73 
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16 

114 
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45 
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32 

45 
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Table  11 

MDIIBSR  OP  RMPLOYEES 
0  -  800  -  10  RATERS 


ConalBtenoy 

Film 

Arithmatio 

Parcant  of 

Oroup  Within 

NO. 

Mean  Rating 

tb% 

17tk^ 

110% 

120% 

1 

102 

80 

90 

90 

100 

2 

104 

10 

80 

80 

80 

S 

103 

10 

80 

60 

90 

4 

83 

40 

70 

90 

90 

5 

102 

40 

80 

60 

100 

6 

126 

40 

80 

70 

90 

7 

92 

SO 

40 

40 

80 

8 

101 

10 

80 

60 

80 

9 

91 

40 

50 

50 

90 

10 

97 

50 

fO 

80 

100 

11 

108 

80 

80 

90 

100 

12 

128 

60 

80 

80 

100 

15 

110 

40 

70 

90 
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14 

108 

80 

TO 

80 

100 

15 

107 

40 

40 

60 

100 

16 

107 

80 

70 

80 

90 

17 

109 

80 

40 

60 

100 

16 

lis 

40 

80 

•0 

100 

Average      36.7 


66.1 


71.1 


93.9 


Aceuraoy 


Pila    Corrected 

Ko»   Mean  Rating  tli% 

1  96  20 

2  96  80 

3  lis  80 

4  79  60 

5  99  80 

6  130  80 

7  82  10 

8  92  80 

9  106  80 

10  96  80 

11  104  80 
I'ti  133  60 

13  103  80 

14  114  40 

15  108  40 

16  102  80 

17  110  80 

18  110  80 

Average  36.1 


Percent  of  Oroup  within 

17^^      210^      1W% 


20 
80 
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80 
80 


80 
80 

60 
80 
80 
70 
80 
80 
40 
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70 
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80 
60 
60 
60 
70 
10 
70 
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Tftbl*  12 

NUMBER  OP   EMPLOYEES 
200   -   1,000  -   37  RATERS 


5S. 


Conelateney 

FllB 

Arithaetic 

Peresnt  of 

Group  Within 

NO* 

Mean  Rating 

i*^;^ 

S"^ 

liof 

S20J 
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111 

41 

52 

57 

84 

• 

114 

43 

65 

77 

89 

S 

111 

28 

46 

63 

86 

4 

06 

26 

34 

46 

83 

ft 

114 

37 

46 

54 

86 
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135 

67 

65 

76 

93 
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103 

23 

61 

57 

89 

• 

108 

45 

51 

71 

92 

0 

101 

84 

35 

44 

79 

10 

112 

43 

54 

63 

92 

11 

118 

33 

54 

71 

95 

12 

186 

44 

54 

79 

90 

IS 

116 

52 

71 

74 

95 

14 

113 

37 

60 

66 

86 

16 

115 

43 

49 

71 

66 

16 

112 

35 

54 

65 

93 

17 

118 

41 

66 

64 

90 

le 

117 

52 

76 

82 

93 

Average 

39.0 

54.6 

66.7 

87 

Aoouracy 

Pllm 

Corrected 

percent  of 

Group  Within 

NO, 

Mean  Rating 

t&% 

I7W 

110% 

220; 
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104 

13 

35 

49 

84 
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106 

40 

57 

60 

86 
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123 
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40 
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83 

4 

87 

17 

26 

37 

71 
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54 
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9 

116 

9 

22 

33 
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92 

11 

113 
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61 

90 

12 

144 

24 

41 

46 

90 

15 

109 

30 

52 

65 

90 

14 

120 

46 

51 
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89 

16 

114 

43 

49 

69 

94 

16 

108 

35 

49 

57 

90 

17 
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90 
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Table  IS 

KUMBER   OF   BMPLOYSBS 
MORE  THAN  l^OOO   -   21   RATERS 

Conalatenoy 

Arithmetic  Percent  of  Qroup  Within 

Mean  Rating     t6%  17j^  IJOjg  l20jC 
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Table  14 

AREA 
MORTUBRM  HIEWEST  (Less  MICHiaAM)  -  20  RATERS 


ponsiatenoy 

PI  la 
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Percent  of 

Group  Within 

NO. 

Mean  Rating 
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AREA 
OBnSAL  MIDWB3T  -  31   RATERS 
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ABSA 

aOUTHKRIi  UimMSf   -  12  RATERS 

Consistency 

PI  la 

Arithnetlo 

Farcant  of 

Oroup  Within 

No. 

||«an  Rating 

t6i      17^ 

110^ 

22Qf 

1 
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26        26 

68 

92 
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67 

92 

5 
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36.6      60.0 
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AREA 

i 

MICHIOAli  •  9 

1  RAT^S 

Consisteney 

Film 

Arithmetic 

pare 

!ant  of 

Group  Within 

BO* 

Mean  Rating 
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22 

22 

2io;l 

44 

120^ 

1 

89 

g 

127 

22 

44 

66 

100 

a 

119 

11 

22 

44 

78 
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81 ZX  OP  CITY 
0  -  6,000  -   17  RaT 


Consiatenoy 

Film 

Arithmetic 

Percent  of 

Group  Within 

NO. 

Mean  Rating 
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Table  10 

SIZI  OF  CITT 
6,000  •  lOfOOO  •  7  RATSaS 

Coneiatgncy 


FilB 

Arlthnatlc 

Percent  of  Qroupt  Within 

Mo« 

Mean  Rating 
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29        29 
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SIZE  OP  CITY 
10^000  -   25^000  •  19   RATSRS 


Conaiatenoy 

Flla 

Arlthaetio 

Parcant  of 

Oroup  Within 

No* 

Mean  Rating 
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Tabl«  SI 

SIZE  OF  CITT 
25,000  •   60,000  -   10  RATBtS 


ponsifltency 

Pllm 

Arithaetio 

Far cant  of 

Group  Within 

No, 

Mean  Rating 

tPf         '-''if 

liof 
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Table  22 

SIZE  OP  CITY 
50,000  -  100,000  -  7  RATERS 


Com 

slatency 

Film 

Arithmetic 

Percent  of 

Oroup  Within 

NO. 

Mean  Rating 
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43 
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Tabl«  23 

SIZE  OP  CITT 
MORK  THAU  100,000  -   11   RATaRS 


44. 
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Percent  of 

Group  Within 

No. 

Mean  Rating 
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Tabl0  24 
RESULTS  OP  F  TB3T 
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(^onaiatenoy 

Farcant  of  Oroup  Within 


paraaetar 

Sxparianea 
Conoapt  of 

Standard 
Initial  Training 
Numbar  of 

Baployaaa 
Araa 
Sica  of  City 


F   Signif. 
Valua  Laval 


F   Signif. 
valua  Leval 


2.67 


4.69 

S.16 
5.43 
6.62 


F   Signify 
Valua  Laval 

1.9S 


1% 
1% 


2,78 
16.26 

2.15 
5*69 
7.82 


1% 


1% 


4.20 
11.88 


7.06 
7.60 


1% 


15 
1% 


Paraaatar 


Accuracy 

Par cant  of  Oroup  within 

U%  l2ii  110% 

F   Signif.    F   Signif.    F   Signif. 
Valua  Leval  Valua  Laval  Valua  Laval 


Bxperianca 

^ 
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1.89 

. 

Gone apt  of 

Standard 

4.04 

• 

3«S4 
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2.93 

• 

Initial  Training 

3.16 

• 

6.13 

8X 

10.66 

1% 

lIUBbar  of 

ftQ}loyaaa 

1.46 

• 

-• 

8.06 

- 

Araa 

• 

m 

3.26 

- 

Size  of  City 

m 

1.06 

- 

2.11 

• 

BXPERIEMCB,  CONCEPT  OP  STANDARD,  VUMBER  OF  EMPLOYEES  hava 
no  significant  diffaranoaa  betwaan  Boana  at  tha  6  parcant 
oonfidanoa  laval  in  eithar  CONSISTENCY  or  ACCURACY. 

TRAlMINOy  only,  haa  a  aignifioant  diffaranea  batwaen  aaana 
at  tha  5  percant  confidanca  laval  in  ACCURACY. 
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Table  25 
RBSULTS  OF  FISHER  t  TEST 

Confidenoa  L«v«l  Betwaan  Faira  Of  Hanaa 

Congiatancy  Only 

pare ant  of  Group  Within 
lb%  t7i%  110% 

Initial  Training 

Ooapany  Ta.  Collage  b%  1%  1% 


Ay* 

Michigan  Ta.  Northam  Midvaat  1^  I^  15( 

Michigan  vs.  Central  Midvast  1%  •  1% 

Michigan  va.  Southern  Midweat  1^  •  If 

All  other  paira  -  -  - 


Size  of  City 

Over  100,000  vs.  0-5,000 

Over  100,000  v».  5-10,000 

Over  100,000  vs.  10-25,000 

Over  100,000  vs.  25-50,000 

Over  100,000  vs.  50-100,000 

5-10,000  vs.  10-25,000 
5-10,000  vs.  25-50,000 
6-10,000  vst  50-100,000 

0-5,000  vs.  25-50,000  b%  If 

All  Other  pairs  «.        •        • 

^Significant  difference  between  means  at  the  1  percent 
confidence  level  for  ACCURACY  alao. 
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